Image sensor and operating method thereof

ABSTRACT

An image sensor includes: a pixel array including a plurality of pixels divided into a plurality of binning areas; a readout circuit configured to, from the plurality of binning areas, receive a plurality of pixel signals including a first sensing signal of first pixels and a second sensing signal of second pixels during a single frame period and output a first pixel value corresponding to the first pixels and a second pixel value corresponding to the second pixels based on the plurality of pixel signals; and an image signal processor configured to generate first image data based on a plurality of first pixel values corresponding to the plurality of binning areas, generate second image data based on a plurality of second pixel values corresponding to the plurality of binning areas, and generate output image data by merging the first image data with the second image data.

CROSS-REFERENCE TO RELATED APPLICATION

This application is based on and claims priority under 35 U.S.C. § 119to Korean Patent Application No. 10-2021-0029083, filed on Mar. 4, 2021,in the Korean Intellectual Property Office, the disclosure of which isincorporated by reference herein in its entirety.

BACKGROUND 1. Field

Embodiments relate to an image sensor and an operating method thereof.

2. Description of the Related Art

An image sensor is a device capturing a two-dimensional orthree-dimensional image of an object. An image sensor generates an imageof an object by using a photoelectric conversion device that reactsaccording to an intensity of light reflected by the object. The recentdevelopment of complementary metal-oxide semiconductor (CMOS) technologyhas allowed for wide use of a CMOS image sensor using CMOS technology.As the demand for high-definition and high-quality photographs andimages has increased, a size of image data generated by an image sensoris increasing.

SUMMARY

An embodiment is directed to an image sensor including: a pixel arrayincluding a plurality of pixels divided into a plurality of binningareas, the plurality of pixels including red pixels, blue pixels, firstgreen pixels, second green pixels, and pixels selected from white oryellow pixels; a readout circuit configured to, from each of theplurality of binning areas, receive a plurality of pixel signalsincluding a first sensing signal of first pixels and a second sensingsignal of second pixels during a single frame period, and output a firstpixel value corresponding to the first pixels and a second pixel valuecorresponding to the second pixels based on the plurality of pixelsignals; and an image signal processor configured to generate firstimage data based on a plurality of first pixel values corresponding tothe plurality of binning areas, generate second image data based on aplurality of second pixel values corresponding to the plurality ofbinning areas, and generate output image data by merging the first imagedata with the second image data. The first pixels may include the redpixels, the blue pixels, the first green pixels, or the second greenpixels, and the second pixels may include the white or yellow pixels.

An embodiment is directed to an image sensor including: a pixel array inwhich a plurality of pixel groups are arranged, each of the pixel groupsincluding color pixels and white pixels sharing a floating diffusionnode; a readout circuit configured to receive, from each of theplurality of pixel groups, during a single frame period, a reset signal,a first image signal including a sensing signal of the color pixels, anda second image signal including sensing signals of the color pixels andthe white pixels and output color pixel values corresponding to thecolor pixels and white pixel values corresponding to the white pixelsbased on the received reset signal, first image signal, and second imagesignal; and an image signal processor configured to generate outputimage data based on a plurality of color pixel values and a plurality ofwhite pixel values corresponding to the plurality of pixel groups.

An embodiment is directed to an operating method of an image sensor, theoperating method including: reading out, from each of a plurality ofbinning areas of a pixel array, a plurality of pixel signals including asensing signal of color pixels and a sensing signal of white pixels in asingle frame period; generating first image data including color pixelvalues based on the plurality of pixel signals; generating second imagedata including white pixel values based on the plurality of pixelsignals; and generating output image data by merging the first imagedata with the second image data.

BRIEF DESCRIPTION OF THE DRAWINGS

Features will become apparent to those of skill in the art by describingin detail example embodiments with reference to the attached drawings inwhich:

FIG. 1 is a block diagram illustrating an image sensor according to anexample embodiment;

FIG. 2 is a diagram illustrating an example of a pattern of a pixelarray of FIG. 1 ;

FIG. 3 is a circuit diagram illustrating a structure of a pixel of apixel array according to an example embodiment;

FIG. 4 is a timing diagram illustrating control signals and a rampsignal provided to a pixel, according to an example embodiment;

FIG. 5A is a diagram illustrating an operation of generatinglow-resolution image data of an image sensor including a pixel arrayhaving an RGBW pattern, according to an example embodiment;

FIG. 5B is a diagram illustrating an operation of generatinglow-resolution image data of an image sensor including a pixel arrayhaving an RGBY pattern, according to an example embodiment;

FIG. 6 is a flowchart of an operating method of an image sensor,according to an example embodiment;

FIGS. 7A through 7D are diagrams for describing a read-out methodaccording to an example embodiment;

FIG. 8 is a block diagram illustrating an electronic device according toan example embodiment;

FIG. 9 is a block diagram illustrating a portion of an electronic deviceaccording to an example embodiment; and

FIG. 10 is a detailed structural block diagram of a camera moduleaccording to an example embodiment.

DETAILED DESCRIPTION

FIG. 1 is a block diagram illustrating an image sensor according to anexample embodiment. FIG. 2 is a diagram illustrating an example of apattern of a pixel array of FIG. 1 .

An image sensor 100 may be mounted in an electronic device having animaging or a light sensing function. For example, the image sensor 100may be mounted in an electronic device such as a camera, a smartphone, awearable device, an Internet of Things (IoT) device, a householdappliance, a tablet personal computer (PC), a personal digital assistant(PDA), a portable multimedia player (PMP), a navigation device, a drone,an Advanced Drivers Assistance System (ADAS), or the like. The imagesensor 100 may be included in an electronic device included as acomponent of a vehicle, furniture, manufacturing equipment, a door, ameasuring instrument, or the like.

Referring to FIG. 1 , the image sensor 100 may include a pixel array110, a row driver 120, a readout circuit 130, a ramp signal generator140, a timing controller 150, and an image signal processor 160.

The pixel array 110 may include a plurality of pixels PX arranged in amatrix, and a plurality of row lines RL and a plurality of column linesCL connected to the plurality of pixels PX. Each of the plurality ofpixels PX may include at least one photoelectric conversion device(which may be referred to as an optical sensing device), and thephotoelectric conversion device may sense light and convert the sensedlight into photocharges. The photoelectric conversion device mayinclude, e.g., an optical sensing device including an organic materialor an inorganic material, such as an inorganic photodiode, an organicphotodiode, a perovskite photodiode, a photo-transistor, a photo-gate,or a pinned photodiode. According to an example embodiment, each of theplurality of pixels PX may include a plurality of photoelectricconversion devices.

The plurality of pixels PX may each sense light of a certain spectralrange from received light. For example, the pixel array 110 may includea red pixel converting light of a red spectral range into an electricalsignal, a green pixel converting light of a green spectral range into anelectrical signal, and a blue pixel converting light of a blue spectralrange into an electrical signal. The pixel array 110 may also includepixels converting light of other spectral ranges into an electricalsignal, such as a white pixel or a yellow pixel, instead of or inaddition to any of the red, green, or blue pixels.

The pixel array 110 illustrated in FIG. 2 as an example may be appliedas the pixel array 110 of FIG. 1 . According to an example embodiment,the pixel array 110 may have an RGBW pattern.

Referring to FIG. 2 , the RGBW pattern may include a first row and asecond row in which a green pixel (e.g., a first green pixel Gr), awhite pixel W, a red pixel R, and a white pixel W are sequentiallyarranged, and a third row and a fourth row in which a blue pixel B, awhite pixel W, a green pixel (e.g., a second green pixel Gb), and awhite pixel W are sequentially arranged, and the first through fourthrows may be repeatedly arranged. In the RGBW pattern, white pixels W inthe first through fourth rows may be arranged in diagonal directionswith respect to each other. In other implementations, color pixels andwhite pixels may be arranged in various manners in the pixel array 110having an RGBW pattern, e.g., white pixels W may be located at positionsof the color pixels Gr, Gb, R, and B of the pixel array 110 disclosed inFIG. 2 , and color pixels may be located at positions of the whitepixels W.

Hereinafter, the pixel array 110 having an RGBW pattern will bedescribed as an example. However, the pixel array 110 may also have,e.g., an RGBY pattern, in which yellow pixels Y are arranged instead ofwhite pixels W.

Referring to FIG. 2 , the pixel array 110 may be divided into aplurality of binning areas BA. Each of the plurality of binning areas BAmay include a plurality of pixels PX arranged in a (2n)×(2n) matrix (nis a positive integer). The plurality of pixels PX included in each ofthe plurality of binning areas BA may share a floating diffusion node FDand output pixel signals via one column line CL. The plurality of pixelsPX sharing the floating diffusion node FD may also be referred to as apixel group.

For example, referring to FIG. 2 , each of the plurality of binningareas BA may include four pixels PX that are arranged in a 2×2 matrixand share the floating diffusion node FD. According to an exampleembodiment, the plurality of binning areas BA may be arranged inparallel to each other in a first direction (e.g., an X-axis direction)and a second direction (e.g., a Y-axis direction) in the pixel array110.

In the present example embodiment, the plurality of binning areas BA areeach a basic unit to which a read-out method (described in furtherdetail below) is applied when the image sensor 100 operates in a firstmode of performing binning, and may respectively correspond to aplurality of binning areas of image data generated based on read-outpixel signals. According to a read-out method of an example embodiment,a plurality of pixel signals may be simultaneously read out in units ofat least two rows from each of the plurality of binning areas BA. Forexample, a plurality of pixel signals of a plurality of pixels PXcorresponding to at least two rows in one frame period may be read out.A read-out method according to an example embodiment will be describedbelow with reference to FIGS. 3 and 4 .

When the image sensor 100 operates in a second mode, e.g., in a normalmode in which binning is not performed, a plurality of pixel signals maybe sequentially read out from the pixel array 110 in units of rows.

Referring further to FIG. 1 , the row driver 120 may generate aplurality of control signals for controlling operation of the pixels PXarranged in each row according to the control by the timing controller150. The row driver 120 may provide a plurality of control signals tothe plurality of pixels PX of the pixel array 110, respectively, via theplurality of row lines RL. In response to the plurality of controlsignals provided by the row driver 120, the pixel array 110 may bedriven in units of at least one row according to an operating mode. Thepixel array 110 may output a plurality of pixel signals via theplurality of column lines CL according to the control by the row driver120.

The readout circuit 130 may include an analog-to-digital converter (ADC)circuit and a line buffer. The ADC circuit may receive a plurality ofpixel signals read out from a plurality of pixels PX of a row selectedby the row driver 120 from among the plurality of pixels PX, and convertthe plurality of pixel signals into a plurality of pixel values, whichare digital data.

The ADC circuit may convert the plurality of pixel signals received fromthe pixel array 110 via the plurality of column lines CL, into digitaldata based on a ramp signal RAMP from the ramp signal generator 140 togenerate and output pixel values in units of at least one row.

The readout circuit 130 may include a plurality of ADC circuitsrespectively corresponding to the plurality of column lines CL, and eachADC circuit may compare a pixel signal received via each column line CLcorresponding to each ADC circuit, to a ramp signal RAMP, and generate apixel value based on results of comparing. For example, an ADC circuitmay remove a reset signal from a sensing signal by using a correlateddouble sampling (CDS) method, and generate a pixel value indicating anamount of light received by a pixel PX. According to an operating modeof the image sensor 100, a pixel value may indicate an amount of lightsensed by a pixel PX or an amount of light sensed by pixels PX in abinning area BA.

A line buffer may include a plurality of line memories, and may store aplurality of pixel values output from an ADC circuit in units of certainrows. Thus, the line buffer may store pixel values output from the ADCcircuit in units of certain rows. For example, the line buffer may storea plurality of pixel values corresponding to one row or a plurality ofpixel values corresponding to two rows according to an operating mode ofthe image sensor 100.

According to an example embodiment, the readout circuit 130 may receivea plurality of pixel signals from pixels PX included in each binningarea BA in a first mode of performing binning, and output color pixelvalues and white pixel values based on the received plurality of pixelsignals. For example, an ADC circuit of the readout circuit 130 mayreceive, from pixels PX included in one binning area BA, a reset signal,a first image signal corresponding to a sensing signal of white pixelsW, and a second image signal corresponding to a sensing signal of colorpixels (e.g., a red pixel R, a blue pixel B, a first green pixel Gr, ora second green pixel Gb) and white pixels W. The ADC circuit may outputa color pixel value and a white pixel value based on the reset signal,the first image signal, and the second image signal. Thus, the readoutcircuit 130 may output a color pixel value corresponding to two colorpixels included in one binning area BA and output one white pixel valuecorresponding to two white pixels included in the one binning area BA.

As described above, a method of outputting one color pixel value and onewhite pixel value from the binning area BA including two color pixelsand two white pixels may be referred to as a 2-sum method. The read-outmethod according to an example embodiment will be described below withreference to FIGS. 3 and 4 .

The readout circuit 130 may receive a plurality of pixel signals frompixels PX in units of rows in a second mode in which binning is notperformed, and output pixel values in units of rows based on thereceived plurality of pixel signals.

The ramp signal generator 140 may generate the ramp signal RAMPincreasing or decreasing at a certain slope, and provide the ramp signalRAMP to the readout circuit 130.

The timing controller 150 may control timing of other components of theimage sensor 100, e.g., timing of the row driver 120, the readoutcircuit 130, the ramp signal generator 140, and the image signalprocessor 160.

The image signal processor 160 may receive pixel values from the readoutcircuit 130, arrange the received pixel values to generate image data,and perform image processing operations such as image qualitycompensation, binning, downsizing, or the like, on the generated imagedata. Accordingly, image-processed output image data OIDT may begenerated and output.

In an example embodiment, in the first mode, the image signal processor160 may generate first image data based on the color pixel values storedin the line buffer and generate second image data based on the whitepixel values stored in the line buffer. In addition, the image signalprocessor 160 may generate the output image data OIDT by merging thefirst image data with the second image data. The image signal processor160 may process the first image data and the second image data in unitsof the binning areas BA. For example, the image signal processor 160 maygenerate output image data OIDT having a reduced data size by merging acolor pixel value corresponding to a first binning area among the firstimage data with a white pixel value corresponding to a first binningarea among the second image data.

In the second mode, the image signal processor 160 may generate originalimage data based on a plurality of pixel values corresponding to aplurality of rows stored in the line buffer, process the generatedoriginal image data, and output the output image data OIDT, of which adata size is maintained.

In an example embodiment, the image signal processor 160 may process thefirst image data, the second image data, and the original image data foreach color. For example, the image signal processor 160 may process eachof red, green, and blue pixels in parallel or in series. In an exampleembodiment, the image signal processor 160 may include a plurality ofprocessing circuits to perform processing for each color in parallel asdescribed above. In another implementation, one processing circuit maybe repeatedly reused.

The output image data OIDT may be output to an external processor, e.g.,an application processor, and the application processor may store theoutput image data OIDT, perform image processing on the output imagedata OIDT, or display the output image data OIDT.

FIG. 3 is a circuit diagram illustrating a structure of a pixel of apixel array according to an example embodiment.

Referring to FIG. 3 , a pixel PXa may include a plurality ofphotoelectric conversion devices PD1, PD2, PD3, and PD4 and a pixelcircuit 111. Each of the plurality of photoelectric conversion devicesPD1, PD2, PD3, and PD4 may be implemented using a photodiode, and amicro-lens may be arranged on each of the plurality of photoelectricconversion devices PD1, PD2, PD3, and PD4. Thus, a combination of amicro-lens with a photoelectric conversion device may be referred to asone pixel, and the pixel PXa of FIG. 3 may be considered as four pixels,accordingly.

The pixel circuit 111 may include a reset transistor RX, a drivingtransistor DX, and a selection transistor SX. First through fourthtransmission transistors TX1, TX2, TX3, and TX4 may be respectivelyconnected to the photoelectric conversion devices PD1, PD2, PD3, andPD4. Control signals, including a reset control signal RS, a selectioncontrol signal SEL, and transmission control signals TS including afirst transmission control signal TS1, a second transmission controlsignal TS2, a third transmission control signal TS3, and a fourthtransmission control signal TS4, may be applied to the pixel circuit111. At least some of the control signals may be generated by the rowdriver 120.

The floating diffusion node FD may be shared among the fourphotoelectric conversion devices PD1, PD2, PD3, and PD4 and the firstthrough fourth transmission transistors TX1, TX2, TX3, and TX4. Thefirst through fourth transmission transistors TX1, TX2, TX3, and TX4 mayrespectively connect the plurality of photoelectric conversion devicesPD1, PD2, PD3, and PD4 to the floating diffusion node FD or block themtherefrom in response to the first through fourth transmission controlsignals TS1, TS2, TS3, and TS4, respectively.

The reset transistor RX may reset charges accumulated in the floatingdiffusion node FD. A driving voltage VDD may be applied to a firstterminal of the reset transistor RX, and a second terminal of the resettransistor RX may be connected to the floating diffusion node FD. Thereset transistor RX may be turned on or off in response to the resetcontrol signal RS received from the row driver 120, and the chargesaccumulated in the floating diffusion node FD may be discharged to resetthe floating diffusion node FD.

Light incident on the plurality of photoelectric conversion devices PD1,PD2, PD3, and PD4 may be accumulated as charges through photoelectricconversion. When the charges accumulated in the plurality ofphotoelectric conversion devices PD1, PD2, PD3, and PD4 are transferredto the floating diffusion node FD, the charges may be output to theoutside as pixel signals using the driving transistor DX and theselection transistor SX. A pixel signal corresponding to a variation ina voltage of the floating diffusion node FD may be transmitted to thereadout circuit 130 of the outside.

The pixel PXa may be applied to the pixel array 110 of FIG. 2 . Forexample, the four photoelectric conversion devices PD1, PD2, PD3, andPD4 of the pixel PXa may respectively correspond to four pixels arranged2×2 in the binning area BA. Thus, the four pixels arranged 2×2 in thebinning area BA in FIG. 2 may respectively share the floating diffusionnode FD like the pixel PXa of FIG. 3 . When the first through fourthtransmission transistors TX1, TX2, TX3, and TX4 are turned on or offsimultaneously, the pixels arranged 2×2 may operate as one large pixelas illustrated in FIG. 2 .

In an example embodiment, two photoelectric conversion devices among theplurality of photoelectric conversion devices PD1, PD2, PD3, and PD4,e.g., PD1 and PD3, may correspond to color pixels, and the other twophotoelectric conversion devices, e.g., PD2 and PD4, may correspond towhite pixels W. For example, referring to FIG. 2 , the two photoelectricconversion devices PD1 and PD3 may correspond to the first green pixelGr, and the other two photoelectric conversion devices PD2 and PD4 maycorrespond to the white pixel W. In another implementation, color pixelscorresponding to photoelectric conversion devices may be the red pixelR, the blue pixel B, or the second green pixel Gb.

FIG. 4 is a timing diagram illustrating control signals and a rampsignal provided to a pixel, according to an example embodiment. FIG. 4will be described on the basis of the pixel PXa of FIG. 3 .

Referring to FIGS. 3 and 4 , operations described below may be performedin a frame period T_FRAME. In the frame period T_FRAME, the selectioncontrol signal SEL may be shifted from a second level (e.g., logic low)to a first level (e.g., logic high) and maintained at the first level.

The reset control signal RS may be shifted from a low level to a highlevel and maintain the high level for a first reset time period RT1. Inthe present example embodiment, the reset transistor RX is turned onaccording to the reset control signal RS of a high level, and thus thefloating diffusion node FD may be reset (reset operation). For example,a voltage of the floating diffusion node FD may be reset to the drivingvoltage VDD.

When the reset operation is ended, as the reset control signal RS isshifted from a high level to a low level, a reset signal RSTcorresponding to charges according to the reset operation, accumulatedin the floating diffusion node FD, may be output for a first time periodT1 via a column line CL. The ramp signal RAMP may be generated todecrease (or increase) at a certain slope for the first time period T1.During the first time period T1 in which a voltage level of the rampsignal RAMP is varied constantly, the readout circuit 130 may comparethe ramp signal RAMP to the reset signal RST.

After the first time period T1 has passed, the first transmissioncontrol signal TS1 may be shifted from a low level to a high level tomaintain the high level for a first transmission time period TT1, andthe third transmission control signal TS3 may be shifted from the lowlevel to the high level to maintain the high level for a thirdtransmission time period TT3. In an example embodiment, the firsttransmission time period TT1 may overlap at least partially with thethird transmission time period TT3.

In the present example embodiment, the first transmission transistor TX1is turned on by the first transmission control signal TS1 of a highlevel, and thus photocharges generated by a first photoelectricconversion device PD1 may be accumulated in the floating diffusion nodeFD (accumulation operation). In the present example embodiment, thethird transmission transistor TX3 is turned on by the third transmissioncontrol signal TS3 of a high level, and thus photocharges generated by athird photoelectric conversion device PD3 may be accumulated in thefloating diffusion node FD (accumulation operation). For example, avoltage of the floating diffusion node FD may decrease from the drivingvoltage VDD according to an amount of accumulated charges.

In the present example embodiment, referring to FIG. 3 , the firstphotoelectric conversion device PD1 and the third photoelectricconversion device PD3 correspond to color pixels, and thus chargescorresponding to color pixel values may be additionally accumulated inthe floating diffusion node FD via the above-described accumulationoperations. Thus, a charge corresponding to a reset operation and acharge corresponding to a color pixel value may be accumulated in thefloating diffusion node FD.

When the accumulation operation is completed as the first transmissioncontrol signal TS1 and the third transmission control signal TS3 areshifted from the high level to the low level, a first image signal SIG1corresponding to the charges accumulated in the floating diffusion nodeFD according to the accumulation operation may be output for a secondtime period T2 via the column line CL. The ramp signal RAMP may begenerated to decrease (or increase) at a certain slope for the secondtime period T2. During the second time period T2 in which a voltagelevel of the ramp signal RAMP is varied constantly, the readout circuit130 may compare the ramp signal RAMP to the first image signal SIG1.

After the second time period T2 has passed, the second transmissioncontrol signal TS2 may be shifted from the low level to the high levelto maintain the high level for a second transmission time period TT2,and the fourth transmission control signal TS4 may be shifted from thelow level to the high level to maintain the high level for a fourthtransmission time period TT4. In an example embodiment, the secondtransmission time period TT2 may overlap at least partially with thefourth transmission time period TT4.

In the present example embodiment, the second transmission transistorTX2 is turned on by the second transmission control signal TS2 of a highlevel, and thus photocharges generated by the second photoelectricconversion device PD2 may be accumulated in the floating diffusion nodeFD (accumulation operation). In the present example embodiment, thefourth transmission transistor TX4 is turned on by the fourthtransmission control signal TS4 of a high level, and thus photochargesgenerated by the fourth photoelectric conversion device PD4 may beaccumulated in the floating diffusion node FD (accumulation operation).

In the present example embodiment, referring to FIG. 3 , the secondphotoelectric conversion device PD2 and the fourth photoelectricconversion device PD4 correspond to white pixels, and thus chargescorresponding to white pixel values may be additionally accumulated inthe floating diffusion node FD via the above-described accumulationoperations. Thus, a charge corresponding to a reset operation, a chargecorresponding to a color pixel value, and a charge corresponding to awhite pixel value may be accumulated in the floating diffusion node FD.

When the accumulation operation is ended as the second transmissioncontrol signal TS2 and the fourth transmission control signal TS4 areshifted from the high level to the low level, a second image signal SIG2corresponding to charges accumulated in the floating diffusion node FDaccording to the accumulation operation may be output for a third timeperiod T3 via the column line CL. The ramp signal RAMP may be generatedto decrease (or increase) at a certain slope for the third time periodT3. During the third time period T3 in which a voltage level of the rampsignal RAMP is varied constantly, the readout circuit 130 may comparethe ramp signal RAMP to the second image signal SIG2.

After the third time period T3 has passed, the reset control signal RSmay be shifted from the low level to the high level and maintained atthe high level for a second reset time period RT2. In the presentexample embodiment, the reset transistor RX is turned on according tothe reset control signal RS of a high level, and thus the floatingdiffusion node FD may be reset (reset operation).

The readout circuit 130 of FIG. 1 may receive the reset signal RST, thefirst image signal SIG1, and the second image signal SIG2, and maygenerate color pixel values and white pixel values based on the receivedsignals.

For example, the readout circuit 130 may calculate color pixel valuesbased on the first image signal SIG1 and the reset signal RST. Forexample, the readout circuit 130 may calculate color pixel values basedon a difference between the first image signal SIG1 and the reset signalRST.

For example, the readout circuit 130 may calculate white pixel valuesbased on the first image signal SIG1 and the second image signal SIG2.For example, the readout circuit 130 may calculate white pixel valuesbased on a difference between the first image signal SIG1 and the secondimage signal SIG2.

As described above, according to the image sensor 100 the presentexample embodiment, by reading out a plurality of pixel signalsincluding a sensing signal of a color pixel and a sensing signal of awhite pixel (or a yellow pixel) from the pixel array 110 having an RGBYpattern (or an RGBY pattern) in a single frame period, a high frame ratemay be maintained and power consumption may be reduced.

FIG. 5A is a diagram illustrating an operation of generatinglow-resolution image data of an image sensor including a pixel array 110having an RGBW pattern, according to an example embodiment. FIG. 5B is adiagram illustrating an operation of generating low-resolution imagedata of an image sensor including a pixel array 110 a having an RGBYpattern, according to an example embodiment.

Referring to FIG. 5A, the pixel array 110 may have an RGBW pattern. Thereadout circuit 130 may receive, in a first mode of performing a binningoperation, a plurality of pixel signals respectively corresponding tobinning areas BA. The readout circuit 130 may calculate color pixelvalues and white pixel values of each of the binning areas BA based onthe plurality of pixel signals to generate first image data IDT1 andsecond image data IDT2.

In the example embodiment of FIG. 5A, the pixel array 110 includessixteen binning areas BA arranged in a 4×4 matrix, and the readoutcircuit 130 may calculate sixteen color pixel values respectivelycorresponding to the sixteen binning areas BA. The readout circuit 130may generate first image data IDT1 based on the calculated sixteen colorpixel values. The readout circuit 130 may calculate sixteen white pixelvalues respectively corresponding to the sixteen binning areas BA, andgenerate second image data IDT2 based on the calculated sixteen whitepixel values.

Referring to FIG. 5B, the pixel array 110 may have an RGBY pattern.Output image data OIDT may be generated according to the above-describedmethod of FIG. 5A.

For example, referring to FIG. 5B, the pixel array 110 a includessixteen binning areas BA arranged in a 4×4 matrix. The readout circuit130 may calculate sixteen color pixel values respectively correspondingto the sixteen binning areas BA, and generate first image data IDT1based on the calculated sixteen color pixel values. The readout circuit130 may calculate sixteen yellow pixel values respectively correspondingto the sixteen binning areas BA, and generate second image data IDT2based on the calculated sixteen yellow pixel values.

The image signal processor 160 may generate output image data OIDT bymerging the first image data IDT1 with the second image data IDT2 inunits of the binning areas BA, e.g., so as to output sixteen valuescorresponding to the sixteen color pixel values respectively merged withthe sixteen yellow pixel values.

FIG. 6 is a flowchart of an operating method of an image sensor,according to an example embodiment. The operating method of FIG. 6 maybe applied to the image sensor 100 of FIG. 1 .

Referring to FIGS. 1 and 6 , the image sensor 100 may read out aplurality of pixel signals including a sensing signal of color pixelsand a sensing signal of white pixels (or yellow pixels) in a singleframe period from each of the plurality of binning areas BA of the pixelarray 110 (S100).

For example, the image sensor 100 may read out a plurality of pixelsignals in a single frame period from a binning area BA including aplurality of pixels PX that share a floating diffusion node. Theplurality of pixel signals that are read out may include a reset signal,a first image signal including a sensing signal of color pixels, and asecond image signal including a sensing signal of color pixels and asensing signal of white pixels (or yellow pixels).

Then, the image sensor 100 may generate first image data IDT1 includinga color pixel value based on the read-out plurality of pixel signals(S200).

For example, the image sensor 100 may generate first image data IDT1including a color pixel value based on a reset signal and a first imagesignal from among the plurality of pixel signals.

Then, the image sensor 100 may generate second image data IDT2 includinga white pixel value (or a yellow pixel value) based on the read-outplurality of pixel signals (S300).

For example, the image sensor 100 may generate second image data IDT2including a white pixel value (or a yellow pixel value) based on thefirst image signal and the second image signal from among the pluralityof pixel signals.

Then, the image sensor 100 may generate output image data OIDT bymerging the first image data with the second image data (S400).

For example, the image sensor 100 may generate the output image dataOIDT by merging the first image data IDT1 with the second image dataIDT2 in units of binning areas BA.

FIGS. 7A through 7D are diagrams for describing a read-out methodaccording to an example embodiment. Hereinafter, for convenience ofdescription, it is assumed that the pixel array 110 includes fourbinning areas BA, i.e., first through fourth binning areas BA1, BA2,BA3, and BA4. However, more binning areas BA may be included in thepixel array 110.

The image sensor 100 may read out a plurality of pixel signals from eachbinning area BA in a first mode of performing a binning operation.Referring to FIGS. 7A and 7C, the image sensor 100 may read out aplurality of pixel signals from each of the first through fourth binningareas BA1, BA2, BA3, and BA4.

In an example embodiment, binning areas BA arranged in a first direction(e.g., an X-axis direction) may share transmission lines for receivingtransmission control signals TS, and binning areas BA arranged in asecond direction (e.g., a Y-axis direction) may share a column line foroutputting pixel signals.

For example, referring to FIG. 7A, the first binning area BA1 and thesecond binning area BA2 arranged in the X-axis direction may sharetransmission control signals Ts<n>, TS_W<n>, TS<n+1>, and TS_W<n+1>.Referring to FIG. 7C, the third binning area BA3 and the fourth binningarea BA4 arranged in the X-axis direction may share transmission controlsignals Ts<n+2>, TS_W<n+2>, TS<n+3>, and TS_W<n+3>. Referring again toFIG. 7A, the first binning area BA1 and the third binning area BA3arranged in the Y-axis direction may share a column line CLm. Referringagain to FIG. 7C, the second binning area BA2 and the fourth binningarea BA4 may share a column line CLm+1.

The image sensor 100 may read out a plurality of pixel signals in unitsof two row lines in each frame period.

For example, referring to FIG. 7C, the image sensor 100 may read out aplurality of pixel signals from each of the first binning area BA1 andthe second binning area BA2 respectively arranged in a first row (e.g.,row n) and a second row (e.g., row n+1) in a first frame periodT_FRAME1.

Then, referring to FIG. 7D, the image sensor 100 may read out aplurality of pixel signals from each of the third binning area BA3 andthe fourth binning area BA4 respectively arranged in a third row (e.g.,row n+2) and a fourth row (e.g., row n+3) in a second frame periodT_FRAME2 after the first frame period T_FRAME1.

Hereinafter, an operation in the first frame period T_FRAME1 will bedescribed in further detail with reference to FIGS. 7A and 7B, and anoperation in the second frame period T_FRAME2 will be described infurther detail with reference to FIGS. 7C and 7D.

Referring to FIG. 7A, the first binning area BA1 and the second binningarea BA2 may share row lines and receive control signals from the rowdriver 120 of FIG. 1 through the row lines, as described above. Forexample, the first binning area BA1 and the second binning area BA2 mayreceive, through four row lines, an n^(th) color pixel transmissioncontrol signal TS<n>, an n^(th) white pixel transmission control signalTS_W<n>, an n+1^(th) color pixel transmission control signal TS<n+1>,and an n+1^(th) white pixel transmission control signal TS_W<n+1>.

In response to the n^(th) color pixel transmission control signal TS<n>,first color pixels, i.e., a first green pixel Gr1 and a red pixel R1, ofthe first binning area BA1 and the second binning area BA2 may transmitcharges accumulated in photoelectric conversion devices to a floatingdiffusion node. In response to the n^(th) white pixel transmissioncontrol signal TS_W<n>, first white pixels W1 of the first binning areaBA1 and the second binning area BA2 may transmit charges accumulated inthe photoelectric conversion devices to the floating diffusion node.

In response to the n+1^(th) color pixel transmission control signalTS<n+1>, second color pixels, i.e., a first green pixel Gr2 and a redpixel R2, of the first binning area BA1 and the second binning area BA2may transmit charges accumulated in the photoelectric conversion devicesto the floating diffusion node. In response to the n+1^(th) white pixeltransmission control signal TS_W<n+1>, second white pixels W2 of thefirst binning area BA1 and the second binning area BA2 may transmitcharges accumulated in the photoelectric conversion devices to thefloating diffusion node.

Referring to FIG. 7B, in the first frame period T_FRAME1, each of thefirst binning area BA1 and the second binning area BA2 may output aplurality of pixel signals in response to the above-describedtransmission control signals, i.e., the n^(th) color pixel transmissioncontrol signal TS<n>, the n^(th) white pixel transmission control signalTS_W<n>, the n+1^(th) color pixel transmission control signal TS<n+1>,and the n+1^(th) white pixel transmission control signal TS_W<n+1>, ann^(th) reset signal RS<n>, and an n^(th) selection signal SEL<n>.

Comparing the embodiment of FIG. 4 to the embodiment of FIG. 7B, thefirst transmission control signal TS1 may correspond to the n^(th) colorpixel transmission control signal TS<n>, and the second transmissioncontrol signal TS2 may correspond to the n^(th) white pixel transmissioncontrol signal TS_W<n>, the third transmission control signal TS3 maycorrespond to the n+1 ^(th) color pixel transmission control signalTS<n+1>, and the fourth transmission control signal TS4 may correspondto the n+1^(th) white pixel transmission control signal TS_W<n+1>, thereset control signal RS may correspond to the n^(th) reset signal RS<n>,and the selection signal SEL may correspond to the n^(th) selectionsignal SEL<n>. A method of outputting the reset signal RST, the firstimage signal SIG1, and the second image signal SIG2 of each of the firstbinning area BA1 and the second binning area BA2 according to levelshift of each of the transmission control signals TS<n>, TS_W<n>,TS<n+1>, TS_W<n+1>, the n^(th) reset signal RS<n>, and the n^(th)selection signal SEL<n> may be applied in the same manner as in theexample described above with respect to FIG. 4 , and thus, repeateddescription thereof will be omitted.

The first binning area BA1 may output the reset signal RST, the firstimage signal SIG1 corresponding to pixel signals of the first greenpixels Gr1 and Gr2, and the second image signal SIG2 corresponding topixel signals of the first green pixels Gr1 and Gr2 and the white pixelsW1 and W2. The second binning area BA2 may output the reset signal RST,the first image signal SIG1 corresponding to pixel signals of the redpixels R1 and R2, and the second image signal SIG2 corresponding topixel signals of the red pixels R1 and R2 and the white pixels W1 andW2.

Referring to FIG. 7C, the third binning area BA3 and the fourth binningarea BA4 may share row lines, and receive control signals from the rowdriver 120 of FIG. 1 through transmission lines.

For example, the third binning area BA3 and the fourth binning area BA4may receive, via four transmission lines, an n+2^(th) color pixeltransmission control signal TS<n+2>, an n+2^(th) white pixeltransmission control signal TS_W<n+2, an n+3^(th) color pixeltransmission control signal TS<n+3>, and an n+3^(th) white pixeltransmission control signal TS_W<n+3>.

First color pixels, i.e., a blue pixel B1 and a second green pixel Gb1,of the third binning area BA3 and the fourth binning area BA4 maytransmit charges accumulated in the photoelectric conversion devices inresponse to the n+2^(th) color pixel transmission control signalTS<n+2>. First white pixels W1 of the third binning area BA3 and thefourth binning area BA4 may transmit charges accumulated in thephotoelectric conversion devices in response to the n+2^(th) white pixeltransmission control signal TS_W<n+2>.

Second color pixels, i.e., a blue pixel B2 and a second green pixel Gb2,of the third binning area BA3 and the fourth binning area BA4 maytransmit charges accumulated in the photoelectric conversion devices inresponse to the n+3^(th) color pixel transmission control signalTS<n+3>. Second white pixels W2 of the third binning area BA3 and thefourth binning area BA4 may transmit charges accumulated in thephotoelectric conversion devices in response to the n+3^(th) white pixeltransmission control signal TS_W<n+3>.

Referring to FIG. 7D, in the second frame period T_FRAME2, each of thethird binning area BA3 and the fourth binning area BA4 may output aplurality of pixel signals in response to the above-describedtransmission control signals, i.e., n+2^(th) color pixel transmissioncontrol signal TS<n+2>, the n+2^(th) white pixel transmission controlsignal TS_W<n+2>, the n+3^(th) color pixel transmission control signalTS<n+3>, the n+3^(th) white pixel transmission control signal TS_W<n+3>,an n+1^(th) reset signal RS<n+1>, and an n+1^(th) selection signalSEL<n+1>.

Comparing the embodiment of FIG. 4 to the embodiment of FIG. 7D, thefirst transmission control signal TS1 may correspond to the n+2^(th)color pixel transmission control signal TS<n+2>, and the secondtransmission control signal TS2 may correspond to the n+2^(th) whitepixel transmission control signal TS_W<n+2>, the third transmissioncontrol signal TS3 may correspond to the n+3^(th) color pixeltransmission control signal TS<n+3>, and the fourth transmission controlsignal TS4 may correspond to the n+3^(th) white pixel transmissioncontrol signal TS_W<n+3>, the reset control signal RS may correspond tothe n+1^(th) reset signal RS<n+1>, and the selection signal SEL maycorrespond to the n+1^(th) selection signal SEL<n+1>. A method ofoutputting the reset signal RST, the first image signal SIG1, and thesecond image signal SIG2 of each of the third binning area BA3 and thefourth binning area BA4 according to level transition of each of thetransmission control signals TS<n+2>, TS W<n+2>, TS<n+3>, TS W<n+3>, then+1^(th) reset signal RS<n+1>, and the n+1^(th) selection signalSEL<n+1> may be applied in the same manner as in the example describedabove with respect to FIG. 4 , and thus, repeated description thereofwill be omitted.

The third binning area BA3 may output the reset signal RST, the firstimage signal SIG1 corresponding to pixel values of the blue pixels B1and B2, and the second image signal SIG2 corresponding to pixel valuesof the blue pixels B1 and B2 and the white pixels W1 and W2. The fourthbinning area BA4 may output the reset signal RST, the first image signalSIG1 corresponding to pixel values of the second green pixels Gb1 andGb2, and the second image signal SIG2 corresponding to pixel values ofthe second green pixels Gb1 and Gb2 and the white pixels W1 and W2.

FIG. 8 is a block diagram illustrating an electronic device according toan example embodiment.

Referring to FIG. 8 , an electronic device 1000 may include an imagesensor 1100, an application processor 1200, a display 1300, a memory1400, a storage 1500, a user interface 1600, and a radio transceiver1700.

The image sensor 1100 of FIG. 8 may correspond to the image sensor ofFIG. 1 . Description of details provided above with reference to FIG. 1will be omitted here.

The application processor 1200 may control the overall operation of theelectronic device 1000 and may be provided as a system on chip (SoC)driving an application program, an operating system, or the like. Theapplication processor 1200 may receive image data from the image sensor1100, and may perform image processing on the received image data. In anexample embodiment, the application processor 1200 may store thereceived image data and/or processed image data in the memory 1400 orthe storage 1500.

The display 1300 may display images, information, etc. provided by theapplication processor 1200.

The memory 1400 may store programs and/or data processed or executed bythe application processor 1200.

The storage 1500 may be implemented using a nonvolatile memory devicesuch as a NAND flash, a resistive memory, or the like, and the storage1500 may be provided using, e.g., a memory card (a multi-media card(MMC), an embedded MMC (eMMC), a secure digital (SD) card, a micro SD).The storage 1500 may store data and/or programs on an executionalgorithm for controlling an image processing operation of theapplication processor 1200, and when an image processing operation isperformed, the data and/or program may be loaded to the memory 1400.

The user interface 1600 may be implemented using various devices viawhich a user input may be received, such as a keyboard, a curtain keypanel, a touch panel, a fingerprint sensor, a microphone. The userinterface 1600 may receive a user input and provide a signalcorresponding to the received user input to the application processor1200.

The radio transceiver 1700 may include a modem 1710, a transceiver 1720,and an antenna 1730.

FIG. 9 is a block diagram illustrating a portion of an electronic deviceaccording to an example embodiment. FIG. 10 is a detailed structuralblock diagram of a camera module according to an example embodiment. Forexample, FIG. 9 illustrates an electronic device 2000 as a portion ofthe electronic device 1000 of FIG. 8 , and FIG. 10 illustrates adetailed structure of a second camera module 2100 b of FIG. 9 .

Referring to FIG. 9 , the electronic device 2000 may include amulti-camera module 2100, an application processor (AP) 2200, and amemory 2300.

The electronic device 2000 may capture and/or store an image of anobject by using a CMOS image sensor, and may be implemented as a mobilephone, a tablet computer, or a portable electronic device. The portableelectronic device may include a laptop computer, a mobile phone, asmartphone, a tablet PC, a wearable device, etc.

The multi-camera module 2100 may include a first camera module 2100 a,the second camera module 2100 b, and a third camera module 2100 c. Themulti-camera module 2100 may include the image sensor 100 of FIG. 1 .Although the multi-camera module 2100 illustrated in FIG. 9 includes thethree camera modules, i.e., the first camera module, the second cameramodule 2100 b, and the third camera module 2100 c, various numbers ofcamera modules may be included in the multi-camera module 2100.

The AP 2200 is described in further detail below, in connection withFIG. 10 .

The memory 2300 may have a same function as the memory 1400 illustratedin FIG. 8 , and repeated description thereof will be omitted.

Hereinafter, referring to FIG. 10 , a detailed structure of the secondcamera module 2100 b will be described in detail. The description belowmay also apply to the other camera modules, the first camera module 2100a, and the third camera module 2100 c.

Referring to FIG. 10 , the second camera module 2100 b may include aprism 2105, an optical path folding element (OPFE) 2110, an actuator2130, an image sensing device 2140, and a storage 2150.

The prism 2105 may include a reflective surface 2107 of a lightreflecting material to deform a path of light L incident from theoutside. According to an example embodiment, the prism 2105 may changethe path of light L incident in the first direction X to the seconddirection Y perpendicular to the first direction X. The prism 2105 mayrotate the reflective surface 2107 of the light reflecting material inan A direction or a B direction around a center axis 2106, therebychanging the path of the light L incident in the first direction X tothe second direction Y perpendicular to the first direction X. The OPFE2110 may also move in a third direction Z perpendicular to the firstdirection X and second direction Y.

In the example embodiment, the maximum rotatable angle of the prism 2105in the direction A may be less than or equal to 15 degrees in thepositive (+) A direction and may be greater than 15 degrees in thenegative (−) A direction.

The prism 2105 may move the reflective surface 2107 of the lightreflecting material in the third direction (e.g., a Z direction)parallel to the direction in which the center axis 2106 extends. In anexample embodiment, the prism 2105 may move the reflective surface 2107of the light reflecting material in the third direction (e.g., a Zdirection) parallel to the direction in which the center axis 2106extends.

The OPFE 2110 may include optical lenses including m (where m is anatural number) groups, and the m lenses may move in the seconddirection Y and change the optical zoom ratio of the camera module 2100b. For example, when the basic optical zoom ratio of the camera module2100 b is Z and the m optical lenses included in the OPFE 2110 aremoved, the optical zoom ratio of the camera module 2100 b may be changedto 3Z, 5Z, or an optical zoom ratio higher than 5Z.

The actuator 2130 may move the OPFE 2110 or optical lenses (hereinafterreferred to as an optical lens) to a particular position. For example,the actuator 2130 may adjust the position of the optical lens, such thatthe image sensor 2142 is positioned at the focal length of the opticallens for accurate sensing.

The image sensing device 2140 may include an image sensor 2142, acontrol logic 2144, and a memory 2146.

The image sensor 2142 may sense an image of a sensing target by usingthe light L provided through the optical lens. The image sensor 2142 ofFIG. 10 may be similar to the image sensor 100 of FIG. 1 functionally,and thus repeated description thereof will be omitted.

The control logic 2144 may control the overall operation of the secondcamera module 2100 b. For example, the control logic 2144 may control anoperation of the second camera module 2100 b according to a controlsignal provided via a control signal line CSLb.

The memory 2146 may store information necessary for the operation of thesecond camera module 2100 b, e.g., calibration data 2147. Thecalibration data 2147 may include information necessary for the secondcamera module 2100 b to generate image data by using the light Lprovided from the outside. The calibration data 2147 may include, e.g.,information about a degree of rotation described above, informationabout a focal length, information about an optical axis, etc. When thesecond camera module 2100 b is implemented in the form of a multi-statecamera in which the focal length is changed depending on the position ofthe optical lens, the calibration data 2147 may include focal distancevalues for respective positions (or states) of the optical lens andinformation related to auto focusing.

The storage 2150 may store image data sensed through the image sensor2142. The storage 2150 may be provided outside the image sensing device2140 and may be stacked with a sensor chip constituting the imagesensing device 2140. The storage 2150 may be implemented with anelectrically erasable programmable read-only memory (EEPROM), forexample.

Referring to FIGS. 9 and 10 together, in an example embodiment, onecamera module (e.g., the first camera module 2100 a) from among thefirst through third camera modules 2100 a, 2100 b, and 2100 c mayinclude four sub-pixels that are adjacent to one another and share thesame color information in one color pixel (i.e., tetra cell), andanother camera module (e.g., the second camera module 2100 b) mayinclude nine sub-pixels that are adjacent to one another and share thesame color information in one color pixel (i.e., a nona cell).

The first through third camera modules 2100 a, 2100 b, and 2100 c mayeach include an actuator 2130. Therefore, the first through third cameramodules 2100 a, 2100 b, and 2100 c may include the same or differentcalibration data 2147 according to the operation of actuators 2130included therein.

In an example embodiment, one camera module (e.g., the second cameramodule 2100 b) from among the first through third camera modules 2100 a,2100 b, and 2100 c may be a folded lens-type camera module including theprism 2105 and the OPFE 2110 as described above, and the other cameramodules (e.g., 2100 a and 2100 c) may be a vertical-type camera modulewithout the prism 2105 and the OPFE 2110.

One camera module (e.g., the third camera module 2100 c) from among thefirst through third camera modules 2100 a, 2100 b, and 2100 c may be avertical type depth camera that extracts depth information by using aninfrared ray (IR), for example. In this case, the AP 2200 may generate a3D depth image by merging image data provided from such a depth camerawith image data provided from another camera module (e.g., the firstcamera module 2100 a or the second camera module 2100 b).

At least two camera modules (e.g., the first camera module 2100 a andthe second camera module 2100 b) from among the first through thirdcamera modules 2100 a, 2100 b, and 2100 c may have different field ofviews (FOVs). In this case, e.g., at least two camera modules (e.g., thefirst camera module 2100 a and the second camera module 2100 b) fromamong the first through third camera modules 2100 a, 2100 b, and 2100 cmay have different optical lenses. For example, the first camera module2100 a from among the first through third camera modules 2100 a, 2100 b,and 2100 c may have a smaller FOV than the second camera module 2100 band the third camera module 2100 c. The multi-camera module 2100 mayfurther include a camera module having a larger FOV than originally usedcamera modules 2100 a, 2100 b, and 2100 c. The first through thirdcamera modules 2100 a, 2100 b, and 2100 c may have different FOVs fromone another. In this case, optical lenses included in the first throughthird camera modules 2100 a, 2100 b, and 2100 c may also be differentfrom one another.

In an example embodiment, the first through third camera modules 2100 a,2100 b, and 2100 c may be physically separated from one another. Thus,the first through third camera modules 2100 a, 2100 b, and 2100 c arenot divided and use the sensing area of one image sensor 2142. Rather,an independent image sensor 2142 may be provided inside each of thefirst through third camera modules 2100 a, 2100 b, and 2100 c.

The AP 2200 may include a plurality of first through thirdsub-processors 2210 a, 2210 b, and 2210 c, a camera module controller2230, a memory controller 2400, and an internal memory 2500. The AP 2200may be implemented separately from the first through third cameramodules 2100 a, 2100 b, and 2100 c. For example, the AP 2200 and thefirst through third camera modules 2100 a, 2100 b, and 2100 c may beimplemented separately from each other as separate semiconductor chips.Image data generated by the first through third camera modules 2100 a,2100 b, and 2100 c may be respectively provided to correspondingsub-processors 2210 a, 2210 b, and 2210 c through image signal linesISLa, ISLb, and ISLc separated from one another. For example, image datagenerated from the first camera module 2100 a may be provided to thefirst sub-processor 2210 a through a first image signal line ISLa, imagedata generated from the second camera module 2100 b may be provided tothe second sub-processor 2210 b through a second image signal line ISLb,and image data generated from the third camera module 2100 c may beprovided to the third sub-processor 2210 c through a third image signalline ISLc. The transmission of image data may be performed by using acamera serial interface based on the mobile industry processor interface(MIPI) standard, for example.

One sub-processor may be provided to correspond to a plurality of cameramodules. For example, the first sub-processor 2210 a and the thirdsub-processor 2210 c may be integrally implemented as a singlesub-processor instead of being implemented separate from each other, andimage data provided from the first camera module 2100 a and the thirdcamera module 2100 c may be selected by a selecting element (e.g., amultiplexer) and provided to an integrated sub-image processor.

The camera module controller 2230 may provide a control signal to eachof the first through third camera module 2100 a, 2100 b, and 2100 c. Acontrol signal generated from the camera module controller 2230 may beprovided to corresponding camera modules 2100 a, 2100 b, and 2100 cthrough control signal lines CSLa, CSLb, and CSLc separated from oneanother.

The memory controller 2400 may control the internal memory 2500.

By way of summation and review, increased size of image data may make itdifficult to maintain a high frame rate and may increase powerconsumption. Thus, an operating mode in which image data having areduced size is generated via a binning operation may be used.

As described above, embodiments relate to an image sensor having a pixelarray of an RGBW pattern or an RGBY pattern, and an operating method ofthe image sensor. Embodiments may provide an image sensor for readingout a plurality of pixel signals including a sensing signal of a colorpixel and a sensing signal of a white pixel (or yellow pixel) in asingle frame period, and an operating method of the image sensor.

Example embodiments have been disclosed herein, and although specificterms are employed, they are used and are to be interpreted in a genericand descriptive sense only and not for purpose of limitation. In someinstances, as would be apparent to one of ordinary skill in the art asof the filing of the present application, features, characteristics,and/or elements described in connection with a particular embodiment maybe used singly or in combination with features, characteristics, and/orelements described in connection with other embodiments unless otherwisespecifically indicated. Accordingly, it will be understood by those ofskill in the art that various changes in form and details may be madewithout departing from the spirit and scope of the present invention asset forth in the following claims.

What is claimed is:
 1. An image sensor, comprising: a pixel arrayincluding a plurality of pixels divided into a plurality of binningareas, the plurality of pixels including red pixels, blue pixels, firstgreen pixels, second green pixels, and pixels selected from white oryellow pixels; a readout circuit configured to, from each of theplurality of binning areas, receive a plurality of pixel signalsincluding a first sensing signal of first pixels and a second sensingsignal of second pixels during a single frame period, and output a firstpixel value corresponding to the first pixels and a second pixel valuecorresponding to the second pixels based on the plurality of pixelsignals; and an image signal processor configured to generate firstimage data based on a plurality of first pixel values corresponding tothe plurality of binning areas, generate second image data based on aplurality of second pixel values corresponding to the plurality ofbinning areas, and generate output image data by merging the first imagedata with the second image data, wherein: the first pixels include thered pixels, the blue pixels, the first green pixels, or the second greenpixels, and the second pixels include the white or yellow pixels.
 2. Theimage sensor as claimed in claim 1, wherein each of the plurality ofbinning areas includes the first pixels and the second pixels sharing afloating diffusion node.
 3. The image sensor as claimed in claim 2,wherein each of the plurality of binning areas includes two first pixelsand two second pixels arranged in a 2×2 matrix.
 4. The image sensor asclaimed in claim 1, wherein the pixel array has a pattern in which: afirst binning area includes the red pixels and the white pixels; asecond binning area includes the blue pixels and the white pixels; athird binning area includes the first green pixels and the white pixels;and a fourth binning area includes the second green pixels and the whitepixels, and the first, second, third, and fourth binning areas arerepeatedly arranged.
 5. The image sensor as claimed in claim 1, whereinthe pixel array has a pattern in which: a fifth binning area includesthe red pixels and the yellow pixels; a sixth binning area includes theblue pixels and the yellow pixels; a seventh binning area includes thefirst green pixels and the yellow pixels; and an eighth binning areaincludes the second green pixels and the yellow pixels, and the fifth,sixth, seventh, and eighth binning areas are repeatedly arranged.
 6. Theimage sensor as claimed in claim 1, wherein the plurality of pixelsignals include: a reset signal; a first image signal including thefirst sensing signal; and a second image signal including the firstsensing signal and the second sensing signal.
 7. The image sensor asclaimed in claim 6, wherein: the readout circuit calculates the firstpixel value corresponding to the first pixels based on the first imagesignal and the reset signal, and the readout circuit calculates thesecond pixel value corresponding to the second pixels based on the firstimage signal and the second image signal.
 8. The image sensor as claimedin claim 1, wherein the image signal processor is further configured togenerate the output image data by merging the first image data with thesecond image data in units of binning areas.
 9. An image sensor,comprising: a pixel array in which a plurality of pixel groups arearranged, each of the pixel groups including color pixels and whitepixels sharing a floating diffusion node; a readout circuit configuredto receive, from each of the plurality of pixel groups, during a singleframe period, a reset signal, a first image signal including a sensingsignal of the color pixels, and a second image signal including sensingsignals of the color pixels and the white pixels, and output color pixelvalues corresponding to the color pixels and white pixel valuescorresponding to the white pixels based on the received reset signal,first image signal, and second image signal; and an image signalprocessor configured to generate output image data based on the colorpixel values and the white pixel values.
 10. The image sensor as claimedin claim 9, wherein each of the plurality of pixel groups includes twocolor pixels and two white pixels.
 11. The image sensor as claimed inclaim 10, wherein each of the plurality of pixel groups includes: twored pixels and two white pixels, or two blue pixels and two whitepixels, or two first green pixels and two white pixels, or two secondgreen pixels and two white pixels.
 12. The image sensor as claimed inclaim 10, wherein each of the plurality of pixel groups includes: afirst photodiode and a second photodiode corresponding to the two colorpixels; a third photodiode and a fourth photodiode corresponding to thetwo white pixels; first through fourth transmission transistorsrespectively corresponding to the first through fourth photodiodes, andconfigured to move charges accumulated in each of the first throughfourth photodiodes to the floating diffusion node; and a resettransistor configured to apply a reset voltage to the floating diffusionnode.
 13. The image sensor as claimed in claim 12, wherein, in each ofthe plurality of pixel groups, the reset transistor is configured to beturned on in response to the reset signal and charges corresponding tothe reset voltage are accumulated in the floating diffusion node, and tooutput the reset signal corresponding to a voltage of the reset floatingdiffusion node.
 14. The image sensor as claimed in claim 13, wherein, ineach of the plurality of pixel groups, after the reset signal is output,the first transmission transistor and the second transmission transistorare configured to be turned on in response to a first transmissioncontrol signal and a second transmission control signal so as toaccumulate, in the floating diffusion node, photocharges generated bythe first photodiode and the second photodiode; and then, the firstimage signal corresponding to a voltage of the floating diffusion node,in which the photocharges are accumulated, is output.
 15. The imagesensor as claimed in claim 14, wherein, in each of the plurality ofpixel groups, after the first image signal is output, the first throughfourth transmission transistors are configured to be turned on inresponse to first through fourth transmission control signals so as toaccumulate, in the floating diffusion node, photocharges generated bythe first through fourth photodiodes; and then, the second image signalcorresponding to a voltage of the floating diffusion node, in which thephotocharges are accumulated, is output.
 16. The image sensor as claimedin claim 9, wherein the image signal processor is further configured togenerate first image data based on a plurality of color pixel valuescorresponding to the plurality of pixel groups, generate second imagedata based on a plurality of white pixel values corresponding to theplurality of pixel groups, and generate the output image data by mergingthe first image data with the second image data in units of pixelgroups.
 17. An operating method of an image sensor, the operating methodcomprising: reading out, from each of a plurality of binning areas of apixel array, a plurality of pixel signals including a sensing signal ofcolor pixels and a sensing signal of white pixels in a single frameperiod; generating first image data including color pixel values basedon the plurality of pixel signals; generating second image dataincluding white pixel values based on the plurality of pixel signals;and generating output image data by merging the first image data withthe second image data.
 18. The operating method as claimed in claim 17,wherein the reading out of the plurality of pixel signals includesreading out a reset signal, a first image signal including the sensingsignal of the color pixels, and a second image signal including thesensing signal of the color pixels and the sensing signal of the whitepixels.
 19. The operating method as claimed in claim 18, wherein thegenerating of the first image data includes generating the first imagedata based on a difference between the reset signal and the first imagesignal.
 20. The operating method as claimed in claim 19, wherein thegenerating of the second image data includes generating the second imagedata based on a difference between the first image signal and the secondimage signal.